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Abstract. We present a novel approach to test the consistency of the cosmological models 
with multiband CMB data using a nonparametric approach. In our analysis we calibrate the 
REACT (Risk Estimation and Adaptation after Coordinate Transformation) confidence levels 
associated with distances in function space (confidence distances ) based on the Monte Carlo 
simulations in order to test the consistency of an assumed cosmological model with observa¬ 
tion. To show the applicability of our algorithm, we confront Planck 2013 temperature data 
with concordance model of cosmology considering two different Planck spectra combination. 
In order to have an accurate quantitative statistical measure to compare between the data 
and the theoretical expectations, we calibrate REACT confidence distances and perform a 
bias control using many realizations of the data. Our results in this work using Planck 2013 
temperature data put the best fit ACDM model at 95%(~ 2er) confidence distance from the 
center of the nonparametric confidence set while repeating the analysis excluding the Planck 
217 x 217 GHz spectrum data, the best fit ACDM model shifts to 70%(~ lcr) confidence 
distance. The most prominent features in the data deviating from the best fit ACDM model 
seems to be at low multipoles 18 < i < 26 at greater than 2cr, t ~ 750 at ~ 1 to 2<r and 
t ~ 1800 at greater than 2<r level. Excluding the 217 x 217 GHz spectrum the feature at 
t ~ 1800 becomes substantially less significance at ~ 1 to 2cr confidence level. Results of 
our analysis based on the new approach we propose in this work are in agreement with other 
analysis done using alternative methods. 
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1 Introduction 

Cosmic microwave background (CMB) observations currently provide the most powerful probe 
of the history and constituents of the Universe. The analyses of the Wilkinson Microwave 
Anisotropy Probe (WMAP) [1, 2] and Planck [3] as the two full sky surveys of CMB ap¬ 
prove the overall validity of the standard ACDM model with six cosmological parameters. In 
spite of the agreement on the cosmological framework, Planck has derived somehow differ¬ 
ent cosmological parameters than what were obtained by WMAP in combination with other 
ground-based CMB surveys such as the Atacama Cosmology Telescope (ACT, [4]) and South 
Pole Telescope (SPT, [5]). There have been so far few investigations to address this ambigu¬ 
ity. [6-8] and [9] discussed that the WMAP angular power spectrum seems to have a higher 
amplitude with respect to Planck’s angular power spectrum at some range of multipoles. [10] 
reported consistency of the angular power spectrum data from WMAP and Planck provided 
an overall amplitude shift and a tension at 3a level with fixed amplitudes. In another attempt 
[11] showed that the concordance model of cosmology is consistent to Planck data only at 2 
to 3 cj confidence level. Recently [12] performed a comprehensive consistency test of WMAP 
9-year data and the Planck 2013 data. They found ~ 2.5% difference in spectra (l > 100) is 
significant at the 3-5cr level. 

In this paper we test the consistency of the concordance model of cosmology with Planck 
2013 data by implementing and calibrating a nonparametric approach known as REACT 
(Risk Estimation and Adaptation after Coordinate Transformation). Using REACT as a 
nonparametric and model-independent methodology, [13] checked the consistency of WMAP 
1, 3, 5, 7-year data with the standard model. This methodology provides a confidence metric 
that measures the consistency of the angular power spectrum data and the expectations of 
a given model. The method was also recently used in [14] and results indicated that the 
concordance model of cosmology is consistent with Planck 2013 data at the level of 36%(~ 
0.5cr). While REACT is a strong statistical framework to test consistency of the models and 
the data, it is very much conservative in its internal measures. In this paper we calibrate 
REACT confidence distances by performing many Monte Carlo simulations to have a more 
precise measurement of the consistency between the Planck 2013 data and the concordance 


- 1 




model. We will show that after calibration, our analysis indicates that the consistency between 
the standard model and Planck 2013 data is only about 2 a confidence level. Since there 
have been various discussions about possible systematic in the Planck 217x217 GHz power 
spectrum [15, 16], we do also perform the analysis excluding this spectrum. 

In what follows, Section 2 describes the two sets of weighted-average angular power spec¬ 
trum data that we used in this work. We discuss nonparametric methodology we used in this 
paper in Section 3 which starts with a review of estimating nonparametric fit and confidence 
set (Subsection 3.1) and validating cosmological models (Subsection 3.2) then continues with 
description of our extensions, calibrating the confidence distances (Subsection 3.3) and bias 
control (Subsection 3.4). In Section 4 we present the results and finally we conclude this work 
in Section 5. 

2 Data 

The Planck satellite measured the CMB temperature anisotropies in a wide range of channels 
from 30 to 353 GHz and provides the temperature angular power spectrum in the multipole 
range of 2 < £ < 2500 [3]. At the multipoles l < 50, the angular power spectrum is derived 
by using all frequency channels from 30 to 353 GHz to remove the Galactic foreground. For 
multipoles £ > 50, the angular power spectra in the frequency range from 100 to 217 GHz 
are contaminated significantly by extragalactic foregrounds. To consider these foregrounds 
appropriately Planck likelihood code implements a foreground model including set of nuisance 
parameters to calculate the likelihood of a cosmological model to the data [6, 7]. 

To provide a single CMB angular power spectrum data, as we need to use in our analysis, 
we follow the same procedure as in [14], Using the nuisance parameters associated with the 
Planck best fit ACDM [6, 7] we obtain the background angular power spectra data in the 
frequency range 100 to 217 GHz. Then we calculate the weighted-average of angular power 
spectra to inverse of their corresponding variance between the contributing frequency channels 
in each multipole £. The weighted-average angular power spectrum, T>n would be 


V e 


wf 


Ech w t 
{of )- 2 


( 2 . 1 ) 


where T>f l = £{£ + 1)C(,/2-k refers to temperature angular power spectrum of associated 
frequency channel in each £. The weight term wf 1 equals to inverse variance, in 

each £ and ch runs for contributing frequency channels. The corresponding covariance matrix 
takes the form 


Cov<35,, V e ) = J Cov(£ w?Vi\J2 «> 

l^ch w l^ch' w ch ch , 

= V Ey E «Co(2.2) 

l^ch w Lch' w cKch , 

where ch and cli' run for the contributing frequency channels and T>f ) is the 

covariance of frequency channels ch and ch' at different multipoles £, £' (provided by Planck 
likelihood code). 
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Using above procedure we obtain two sets of wighted-angular power spectrum data and 
corresponding covariance matrices from Planck 2013 data. The angular power spectrum data 
set 1 is made by using the all frequency channels at multipoles t > 50 (listed in Table 1). In 
addition we calculate the angular power spectrum data set 2, similar to the data set 1 but 
excluding the Planck 217 x 217 GHz angular power spectrum. The Figure 1 depicts both 
data sets. We see at multipoles greater than t ~ 2000 the noise level of data set 2 is higher 
than data set 1 which is due to excluding the the 217 X 217 GHz angular power spectrum. 


Spectrum 

Multipole range 

100 x 100 

143 x 143 
217 x 217 

143 x 217 

50-1200 

50-2000 

500-2500 

500-2500 


Table 1 . The multipole ranges of the spectra and the cross-spectra provided by Planck 2013 data 
for i > 50 [6]. 


3 Methodology 

The REACT is a nonparametric function estimation and was initially proposed by [17-20] 
and then modified and used in CMB data analysis by [13, 14, 21-23]. 

The function estimation or regression methods estimate the unknown function /, related 
to given data set, by using the estimate /. The nonparametric function estimation method¬ 
ologies do not assume a specific functional form for / and attempt to estimate the function 
with some mild regularity assumptions such as smoothness or membership of / to a function 
space, etc. In REACT formalism an estimate / of unknown function / is obtained by bal¬ 
ancing bias and variance of / through optimal smoothing which is achieved by minimizing 
the risk function. This nonparametric methodology also constructs a confidence set around 
the / which can be employed in many aspects of inference. 

In this section we first present a review of this methodology (Subsections 3.1 and 3.2) 
which is mainly based on [13, 21, 22], Our calibration of confidence distances based on the 
Monte Carlo simulations in order to test the consistency of an assumed cosmological model 
with observation, is presented in Subsection 3.3. In addition we describe (Subsection 3.4) 
a way of bias estimation of / based on the Monte Carlo simulations to demonstrate the 
consistency in multipole space. 

3.1 The nonparametric fit and confidence set 

The CMB angular power spectrum data is given in the form of 


Yu — T)fi + q (3-1) 

where Yf repersents the N observed data points over multipoles equal to true but unknown 
angular power spectrum T>£ = f(xe) contaminated with the noise, e/, which is assumed to 
have normal distribution with mean-0 and known covariance matrix E. 
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Figure 1. The weighted-average Planck 2013 temperature angular power spectrum data. Data 
set 1, is the weighted-average of the background CMB angular power spectra from combination of 
100 x 100 GHz, 143 x 143 GHz, 217 x 217 GHz and 143 x 217 GHz spectra at (£ > 50). Data set 2, 
is similar to data set 1, except that the angular power spectrum of 217 x 217 GHz is excluded. The 
angular power spectrum at £ < 50 in both data sets is given by Planck team and obtained by using 
the Planck frequency channels from 30 to 353 GHz [6]. 


The main assumption in REACT formalism is that the unknown function /, belongs to 
Z /2 function space, such as it can be expanded in a complete orthonormal basis {</>j(x)}, 


f(x) 

j =0 


A proven useful basis for the CMB angular power spectrum estimation is the cosine basis 
defined over 0 < x < 1: 


M x ) 


1 (j = 0 ) 

y/2cos(jTrx) (j = 1,2, . . .) 


(3.2) 
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Assuming / is sufficiently smooth and considering N data points, we can take 


/(*) 


N -1 


X PiM x )> 

3=0 


and estimate it as 


N -1 


/(*) = X PjM x )- 

3=0 


(3.3) 


The angular power spectrum T>( = f{xg) would be estimated as T>g = 
coefficient estimates Pj which are estimated as 


f(xg) through 


Pj — ^jZj, ( 3 - 4 ) 

where 

1 n— 1 (TJ t Y) ■ 

Z i = N^2 Y iM x i ) = rjpr 3 ■ ( 3 ' 5 ) 

i =0 v iV 

Here, U is the orthonormal matrix defined as U tJ = <pj(x t )/\fN and Y = (lo,..., 1 jv _\) T 
Finding the coefficient estimates /3 = (/?o, • • •, Pn~i) T , an( 4 hence the f(x), could be 
reduced to determining the shrinkage parameters A j. The smoothness assumption of / implies 
a fast decay of the true coefficients Pj with j. This suggests a monotonically decreasing 
constraint on shrinkage parameters 


1 > Ao > Ai > ... > Ajv-i > 0 (Monotone shrinkage). (3.6) 

Using shrinkage parameters one can define the effective degree of freedom (EDoF) as 


N—l 

EDoF(A) = 

3=0 


Effective degree of freedom can be used to characterize the nonparametric function estimation 
f(x) and interpreted as the degree of smoothness. 

In this formalism the difference between the true unknown function f(x) and its esti¬ 
mator f(x) is measured via the inverse-noise-weighted loss function L(A), 


L(A) = 



( f( x ) - f ( x ) 

V ^(®) 


2 

dx. 


(3.8) 


where cr 2 (x) is the variance of the data Y and A = (Ao,..., Xn-\) t is the vector of shrinkage 
parameters. 

Optimal smoothing is obtained by balancing the bias of the function estimator f(x) 
with its variance, by minimizing the risk function R( A), which is the expected value of loss 
function L( A), 


R( A) 




dx + f E 
Jo 



dx. 
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Where the two terms are the integrated squared bias and the integrated variance of function 
estimator f(x), both weighed by l/a 2 (x). 

Since the risk function R( A) depends on the unknown function /, it needs to be estimated 
through an estimator. A particular Stein’s Unbiased Risk Estimator (SURE) [24] of this risk 
take the following form 

R{ A) = Z t DWDZ + tr {DWDB) - tr {DWDB) (3.9) 

where D = diag(Ao, ■.., Ajy_i), D = In — D, Z = {Zq, ..., Zn-i) T , B = U t T,U/N is 
the covariance of Z, and Ijy is the N X N identity matrix. Using approximate expansion 
(1 /ct 2 (.t)) ~ Sj^o 1 w jM x )’ the we iglit matrix W would be defined as 

Wjk = ^ Aj k iwi, (3.10) 

i 


where, 


^jkl — 



(j>j(x)^>k(x)^i(x) dx 


fl, if#{j,M = 0} = 3, 

0, if#{j,M = 0} = 2, 

5jk$oi + dji6 0 k + SuSoj, if #{j, k, Z = 0} = 1, 

k ~^{di,j+k + $l,\j-k\) if #{j) k, l = 0} = 0. 


for the cosine basis (Eq. 3.2). 

We have already mentioned the optimal nonparametric fit obtained by minimizing risk 
R( A) by A and through Equations 3.3 & 3.4. The estimated fit is the nonparametric fit 
without any restriction on its EDoF which is called the full-freedom fit. This full-freedom 
fit in CMB data analysis can be quite wiggly in some multipoles where the noise levels in 
the data is high. While this full-freedom fit is a reasonable reconstruction (in a sense that it 
captures the essential trends in the data), most cosmological models predicts smooth forms 
of the angular power spectrum. Alternatively, imposing additional constraint of the form 


N -1 

A * = 

i =0 


(3.11) 


where q constrains the EDoF of the fit, leads to the smoother restricted-freedom fit. By 
gradually reducing the value of EDoF (relative to the full-freedom fit) we can obtain an 
acceptably smooth fit. 

Conventional curve estimation methods provide a confidence band around the best fit 
that indicates the uncertainty in the reconstruction. Instead, this nonparametric methodology 
quantifies the uncertainty surrounding the nonparametric fit in the form of a high-dimensional 
(1 — a) confidence set (confidence ball ) at a pre-specified 0 < (1 — a) < 1 confidence level. By 
definition the confidence ball asymptotically contains the true model with probability equal 
to associated confidence level. This confidence set for coefficient vector (3 is centered at (3 and 
is defined as 

S N ,a = {p-{p~ P) T W((3 -P)< rl } , (3.12) 

where the confidence radius r a is calculated by 


r 


2 

a 


TZg 

Vn 


+ R( A). 


(3.13) 


6 




Here z a is upper a quantile of standard normal distribution, and 

? 2 /N = 2tr (ABAB) + Z T QZ - tr (QB), (3.14) 

where Q = 4 (ABA + WDBDW - 2ABDW) and A = DW + WD - W. 

On the other hand, loss function (Equation 3.8) can be written approximately for N 
data points as 


m 


-i &max 

N E 


l=£n 


f(Xj) - f(x e ) 
cr(xi) 




(3.15) 

(3.16) 


Consequently the high-dimensional confidence set around the /3 (Equation 3.12) can be in¬ 
terpreted as a confidence ball in a high-dimensional function space with the center of non¬ 
parametric fit / weighed by l/cr 2 (x^), with the same confidence radius r a (Equation 3.13) 
to (1 — a) pre-specihed confidence level. Apart from the main application of confidence ball 
which is determining the uncertainties on the nonparametric fit and associated features, we 
can employ this for validating different cosmological models in a model-independent way. We 
will discuss this in the next subsection. 


3.2 Validating cosmological models 


Basically the high-dimensional confidence ball, centered in the nonparametric fit, determines 
the uncertainties around the fit. Furthermore we can use this concept for validating different 
cosmological models against the data model-independently. In this regard we measure the 
distance d of the point associated to a predicted angular power spectrum of a specific cosmo¬ 
logical model to the center of the confidence ball. Using Equation 3.15 the distance, d, would 
be 


d 


\ 


-i Zmax 

- y 

N ^ 


'remodel 

U i 


-v e 


£=£„ 


&£ 


(3.17) 


where T>n and D™ odel are nonparametric and predicted angular power spectrum in each l 
respectively. The <r 2 is the variance of angular power spectrum data in each i and N is the 
total number of multipoles. This distance can be associated to the confidence level that a 
proposed angular power spectrum can be rejected as a candidate for the true model ( confidence 
distance). For this purpose if we rearrange the Equation 3.13, the upper a quantile of standard 
normal distribution z a (d), associated with distance d would be 


z a (d) = (d 2 - R( A)) (3.18) 

By definition the cumulative distribution function of the standard normal distribution of z a {d) 
represents confidence distance (associated confidence level with particular distance d). In 
other words through this procedure we can measure the consistency of a specific cosmological 
model with the data in a model-independent way. 
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3.3 Calibrating confidence distances 


Although the original formalism in REACT provides an elegant procedure to assign a confi¬ 
dence level to a particular distance from the center of nonparametric confidence set. However, 
in this procedure the calculated confidence level is highly dependent on the minimum risk 
value of the nonparametric fit (Equation 3.18) which is based on a single data realization and 
REACT is usually very conservative in estimation of inconsistencies between data sets and 
models. To address this issue and in order to have a more accurate estimation of the level of 
consistency (or inconsistency) between the concordance model of cosmology and Planck 2013 
data we perform a calibration based on many simulated realizations of the angular power 
spectrum data, Since the main goal is to check the consistency of the Planck best fit 

ACDM model with data, we assume the Planck best fit ACDM as the true model and add 
the Gaussian noise according to the calculated covariance matrix in Equation 2.2. Next we 
estimate the full-freedom fit, T>fi m , of each simulated angular power spectrum data. 

Using Equation 3.17, the distance of the Planck best fit ACDM (true model) and the 
full-freedom fit, of each simulated angular power spectrum data, can be calculated. 

The empirical Cumulative Distribution Function (CDF) of these distances can be used as 
the calibrated confidence level of distances (calibrated confidence distances). Statistically, the 
obtained CDF indicates the probability of existence of true model in distance of shorter or 
equal to a specific distance in function space. In fact these calibrated confidence distances 
present the (calibrated) confidence levels associated to distances from nonparametric fit in 
function space. We demonstrate these results in Section 4. 

It is worth noting that while the nonparametric fit obtained by minimizing the risk 
estimator R( A) depends on the full covariance matrix of data £ (Equation 3.9), the distance 
d (Equation 3.17) which is derived from the loss function uses only the diagonal terms of 
£. This would not affect the reliability of the final results since we have used Monte Carlo 
simulations and treated the real and simulated data in a same way. However, the method 
may become more sensitive to possible features in the angular power spectrum if the full 
covariance matrix in defining distances is employed. 


3.4 Bias control 

In Subsection 3.1 we see the nonparametric fit is estimated by minimizing the risk function 
that results to an optimally smooth reconstruction. In principle, too much of smoothing 
leads to a fit with high bias and low variance, and too little smoothing yields a fit with low 
bias and high variance. Minimal risk (optimal smoothing) therefore can be thought then as a 
reconstruction with a balance between the bias and the variance. Therefore the nonparametric 
fit in this formalism has an optimal smoothing with the cost of some bias. 

Using the simulations we mentioned earlier, we are able to estimate the bias and make 
our reconstructions more accurate. In this procedure we use the distribution of the full- 
freedom fits, in each t obtained from our simulated angular power spectrum data to 

find out the form of the bias. The median of the distribution of T>f m in each i represents an 
estimated angular power spectrum, V) ned , which tends to show true angular power spectrum, 
T>(™ e . Therefore the bias can be estimated as 


bias(f) = Vf ed - V\ rue 


(3.19) 
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Then the calibrated unbiased nonparametric fit, 'D^ nb , is obtained by subtracting the bias at 
each £ from the nonparametric fit, 

Vf' }> = V t - bias(£) (3.20) 

The residual of Planck best fit ACDM and unbiased nonparametric fit can be calculated 
as 

Res(f) = vf CDM - V^ nb (3.21) 

where Res(£) is the residual value at each £ and the T>f c DM is the Planck best fit ACDM. Since 
we assume the best fit ACDM as the true model in simulation procedure (Subsection 3.3), 
then V t [ ue = Vf CDM . Therefore from Equations 3.19, 3.20 and 3.21, the residual equation 
would be simplified to 

Res(^) = Vf ed - V( (3.22) 

The residual, Res(f'), represents the deviation of the Planck best fit ACDM model from 
Planck 2013 data in different multipole ranges estimated by the unbiased nonparametric 
reconstruction, V^ nb . 

In addition, the uncertainties of unbiased nonparametric fit, can be estimated by 
simulations. Using the distribution of the full-freedom fits, T>f m , in each £, we can estimate 
the corresponding 1 and 2c error bars around V™ ed . These uncertainties would be propagated 
identically to in each £, through Equations 3.19 & 3.20. They can be used to quantify the 
deviation of the Planck best fit ACDM model from the unbiased nonparametric reconstruction 
in terms of confidence levels. 

4 Results 

The full-freedom fit and the restricted-freedom fit of data set 1 (full Planck 2013 data) 
correspond to EDoF ~ 130 and EDoF = 25 respectively. Figure 2 (top panel) shows the full- 
freedom fit and the restricted-freedom fit of data set 1 with green and red points. Applying 
the same nonparametric methodology (described in Subsection 3.1) on data set 2 (Planck 
2013 data excluding 217 x 217 GHz) we achieve the full-freedom fit at EDoF ~ 106 and the 
restricted-freedom fit at EDoF = 26. The full-freedom fits (Figures 2 and 3, green points) 
turn out to be a little wiggly most likely due to the noise in the corresponding data set. 
Rather, the restricted-freedom fits (Figures 2 and 3, red points) exhibit a smooth angular 
power spectrum with 6 peaks up to l ~ 2000 as expected in the standard cosmology. We 
see for both sets of data, the restricted-freedom fits follow the corresponding full-freedom 
fits closely. For comparison we also plot the Planck best fit ACDM (Figures 2 and 3, black 
points). We see all three fits by and large follow the same trend except for small deviations. 
In particular, the best fit ACDM model shows an up-turn at £ < 10 which we expect to see in 
the concordance model of cosmology due to the integrated Sachs-Wolfe effect [25]. However, 
neither the restricted-freedom nonparametric fits nor the full-freedom fits, reveal such an 
upturn. 

For testing the consistency of the Planck best fit ACDM and the data we employ the 
Monte Carlo simulation described in Subsection 3.3. The simulations mimic 1000 independent 
observations of angular power spectrum for data set 1 and 2 all based on the best fit ACDM 
model. Applying the nonparametric method we obtain the full-freedom fits of the simulated 
data and the corresponding distances to the Planck best fit ACDM (as the true model). The 
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Multipole, I 


Figure 2. (Top panel) The nonparametric fits for Planck 2013 temperature angular power spectrum 
data (data set 1). Green: full-freedom fit (EDoF ~ 130), red: restricted-freedom fit (EDoF = 25), 
black: best fit ACDM model, blue: data set 1, Planck 2013 angular power spectrum data. The bottom 
panel illustrates the residuals of the best fit ACDM model with respect to unbiased nonparametric 
fits. The la and 2cr confidence bands are plotted in dark and light gray colors. Results show the 
deviation of the best fit ACDM model from data in three multipole ranges (highlighted in top panel 
inset plots). These deviations are at low multipoles 18 < £ < 26 with greater than 2cr significance, 
l ~ 750 at 1 to ~ 2a significance and (, ~ 1800 at greater than 2cr significance. 


estimated Probability Density Functions (PDF) of the calculated distances are shown for 
data set 1 and data set 2, in Figure 4, top-left and top-right panels respectively. Furthermore 
the corresponding empirical Cumulative Distribution Functions (CDF) are plotted in Figure 4 
(bottom panels). These plots will provide us a scale that at what distances the best fit ACDM 
model and the full-freedom non-parametric fits should stand if the observed data is a true 
realization of the concordance model. 

Using the Equation 3.17, the Planck best fit ACDM stands in function space at the 
distances 1.172 x 10 -1 and 9.932 x 10~ 2 to the full-freedom fits associated with data set 1 and 
data set 2 respectively. Locating these numbers in the CDF diagrams of the data set 1 and 2 
(Figure 4, bottom panels) we find that the corresponding confidence levels of these distances 
are 0.95 and 0.70 respectively. 

Deriving the confidence levels, we also attempt to transfer these information from the 
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Figure 3. (Top panel) The nonparametric fits for Planck 2013 temperature angular power spectrum 
data excluding 217 x 217 GHz spectrum (data set 2). Green: full-freedom fit (EDoF ~ 106), red: 
restricted-freedom fit (EDoF = 26), black: best fit ACDM model, blue: data set 2, Planck angular 
power spectrum data (excluding 217 x 217 GHz power spectrum). The bottom panel illustrates the 
residuals of the best fit ACDM model with respect to unbiased nonparametric fits. The 1 <t and 2cr 
confidence bands are plotted in dark and light gray colors respectively. The residual of unbiased 
full-freedom fit (green curve) and unbiased restricted-freedom fit (red curve) show the deviation of 
the best fit ACDM model from data in three multipole ranges (highlighted in top panel inset plots). 
They show the deviations at low multipoles 18 < £ < 26 with greater than 2cr significance, £ ~ 750 
at 1 to ~ 2cr significance and £ ~ 1800 at 1 to ~ 2er significance. The significance of the feature at 
£ ~ 1800 is reduced considerably by excluding the 217 x 217 GHz spectrum from the Planck 2013 
data. 


function space to multipole l angular power spectrum space. As described in Subsection 3.4, 
we try to remove the bias from the nonparametric fits in order to compare them with the best 
fit ACDM model. We use distribution of 1000 full-freedom fits at each t obtained from the 
simulated angular power spectrum data (which are all based on the best fit ACDM model) and 
calculate the median values, T>J tf ' d . We use these median values at each i to derive residuals 
through Equation 3.22. Figures 2 and 3 (bottom panels) illustrate the residual values of the 
best fit ACDM model with respect to the (unbiased) full-freedom fit (green curve) using data 
set 1 and data set 2 respectively. The median, T>" ied is indicated as the zero line (black dotted 
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line) in these plots. The la and 2 a confidence bands based on the simulations are shown 
by dark and light gray colors. We should note here that since in Figures 2 and 3 (bottom 
panels) we plot the residuals of the best fit ACDM model with respect to the nonparametric 
fit the zero line represents the nonparametric fit. From Figure 2 (bottom panel) we see that 
the most prominent deviations between the nonparametric reconstructions and the best fit 
ACDM model seems to be at low multipoles 18 < £ < 26 at greater than 2<r significance, 
£ ~ 750 at 1 to ~ 2(j significance and £ ~ 1800 at greater than 2cr significance. For better 
illustration these three regions are replotted in top panel, inset plots. Figure 2 (bottom panel) 
shows the similar plots for data set 2 (Planck 2013 excluding 217 x 217 GHz spectrum). We 
see that the feature at £ ~ 1800 becomes substantially less significant at 1 to ~ 2a confidence 
level. Considering all these, the deviations at low multipoles and £ ~ 750 looks to be the 
most prominent feature in the Planck 2013 data. 

5 Conclusion 

In this paper we have calibrated REACT confidence distances to present an algorithm to 
accurately estimate the consistency of an assumed theoretical cosmological model with CMB 
data. Using our nonparametric method we reconstruct the form of the angular power spec¬ 
trum from the data and compare our results with the theoretically expected angular power 
spectrum. We recently performed an analysis of comparing the best fit ACDM model and 
Planck data using REACT in [14] where we have calculated the confidence distance of the 
standard ACDM model from the center of the nonparametric confidence set. 

However, in this work in order to have a more accurate quantitative statistical measure 
of comparison between the nonparmetric results and the model theoretical expectations we 
calibrated our consistency measure using many realizations of the data all based on the 
same theoretical model. While the actual REACT is very conservative in estimation of the 
inconsistencies between data sets and models and we found previously that the best fit ACDM 
model is at 36%(~ 0.5cr) confidence distance from the center of the nonparametric confidence 
set using Planck 2013 temperature data, our calibrated results put the best fit ACDM model 
at 95%(~ 2cr) confidence distance from the center of the nonparametric confidence set. In 
this work we have simulated 1000 Monte Carlo realizations of the Planck 2013 temperature 
angular power spectrum data based on the best fit ACDM model and for each realization we 
derived the confidence distance between the best nonparametric fit and the true model. We 
used the distribution of these confidence distances from the simulations to calibrate REACT 
in this particular problem and we compared the derived distribution with the results from 
the actual data. Our results indicate that the distance between the best fit ACDM model 
from the center of the nonparametric confidence set in the case of the real Planck 2013 
temperature data is larger than the similar distances we derived in simulations in 95% of the 
cases. Our results seems to be in a very close agreement with some other analysis discussing 
the same subject using different methodologies [10-12], Excluding the 217 GHz data from our 
analysis, the best fit ACDM model shifts to 70%(~ la) confidence distance from the center 
of nonparametric confidence set resulting to better consistency of the standard model with 
Planck data. While the 217 X 217 spectrum is one of the most precise CMB measurements 
of the Planck, in [15] it has been mentioned that there has been a small systematic in this 
frequency channel (apparently due to incomplete removal of 4 K cooler lines). This probably 
can be a reason behind the significant inconsistency we derived between the standard ACDM 
model and full Planck 2013 data. Excluding the 217 x 217 spectrum from our analysis and 
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Figure 4. The estimated Probability Density Functions (PDF) of the distance parameter, d, 
(Equation 3.17) from 1000 simulations of the Planck 2013 data (based on the best fit ACDM model) 
for data set 1 (top-left panel) and data set 2 (top-right panel). The bottom panels shows the empirical 
Cumulative Distribution Function (CDF) corresponding to PDF of data set 1 (left-bottom panel) and 
data set 2 (right-bottom panel). In comparison and in the case of the actual real data, the Planck 
2013 best fit ACDM stands at 1.172 x 10” 1 distance (left-bottom panel, green vertical dotted line) 
from the corresponding full-freedom fit in the function space. This can be interpreted that the best fit 
ACDM model is consistent to the Planck 2013 data at 95%(~ 2er) confidence level (left-bottom panel, 
green horizontal dotted line). Excluding the 217 x 217 GHz spectrum (data set 2), the Planck best fit 
ACDM stands in 9.932 x 10 -2 distance (right-bottom panel, green vertical dotted line) with respect 
to the corresponding full-freedom fit in the function space which make this model to be consistent 
to the data set 2 (Planck 2013 excluding 217 x 217 GHz spectrum) at 70%(~ ler) confidence level 
(right-bottom panel, green horizontal dotted line). 
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getting significantly better consistency between Planck 2013 and the concordance model seems 
to support this argument. However, repetition of the analysis using Planck 2015 can make 
things much more clear. 

Using this algorithm we can also highlight the angular scales where the assumed the¬ 
oretical model deviates from the data (with considerable statistical significance) using large 
number of simulations and after some bias control. We should recall that REACT and conse¬ 
quently our calibrated REACT in this analysis is a biased estimator and while this would not 
affect our consistency test, to look for angular scales deviating from the concordance model 
we should perform a bias control. We can perform this bias control using extensive simula¬ 
tions and subsequently correct/modify the estimated forms of the angular power spectrum. 
Applying our approach on Planck temperature 2013 data and assuming the best fit spatially 
flat ACDM model, after performing the bias control and error-estimation our results indicate 
that the most prominent features in the Planck 2013 data deviating from the best fit ACDM 
model seems to be at low multipoles 18 < £ < 26 with greater than 2cr significance, £ ~ 750 
at 1 to ~ 2cr significance and £ ~ 1800 with greater than 2cr significance. Excluding the 217 
GHz data the feature at £ ~ 1800 becomes substantially less significant at 1 to ~ 2cr. While 
the feature at £ ~ 1800 seems to be due to some systematics in the data, the features at 
£ ~ 750 looks to be the most prominent feature in the Planck 2013 data. Similar results have 
been reported earlier using alternative methods [26]. 

To summarize, in this paper we propose an approach based on calibration of REACT 
confidence distances where we can test the consistency of a particular theoretical model with 
CMB observations and also look for the multipole scales where there are significant deviations. 
We have applied the method on Planck 2013 data in order to show its strength and simplicity 
and it can be trivially used against forthcoming data including Planck 2015. 
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